The validation of (advanced) bibliometric indicators through peer assessments: A comparative study using data from InCites and F1000

نویسندگان

  • Lutz Bornmann
  • Loet Leydesdorff
چکیده

The data of F1000 and InCites provide us with the unique opportunity to investigate the relationship between peers’ ratings and bibliometric metrics on a broad and comprehensive data set with high-quality ratings. F1000 is a post-publication peer review system of the biomedical literature. The comparison of metrics with peer evaluation has been widely acknowledged as a way of validating metrics. Based on the seven indicators offered by InCites, we analyzed the validity of raw citation counts (Times Cited, 2nd Generation Citations, and 2nd Generation Citations per Citing Document), normalized indicators (Journal Actual/Expected Citations, Category Actual/Expected Citations, and Percentile in Subject Area), and a journal based indicator (Journal Impact Factor). The data set consists of 125 papers published in 2008 and belonging to the subject category cell biology or immunology. As the results show, Percentile in Subject Area achieves the highest correlation with F1000 ratings; we can assert that for further three other indicators (Times Cited, 2nd Generation Citations, and Category Actual/Expected Citations) the “true” correlation with the ratings reaches at least a medium effect size. © 2012 Elsevier Ltd. All rights reserved.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Comparative analysis of a set of bibliometric indicators and central peer review criteria Evaluation of condensed matter physics in the Netherlands

In this paper first results are presented of a study on the correlation between bibliometric indicators and the outcomes of peer judgements made by expert committees of physics in the Netherlands. As a first step to study these outcomes in more detail, we focus on the results of an evaluation of 56 research programmes in condensed matter physics in the Netherlands, a subfield which accounts for...

متن کامل

The Comparative Effects of Self-assessment and Peer Feedback on Improving Translation Quality

This study investigated the effect of self-assessment and peer-assessment on the quality of students’ transla- tion. Participants of the study were 60 male and female students. They were selected from the senior stu- dents studying English Translation and divided into two groups: self-assessment and peer-assessment. The study adopted a pretest-posttest design, and students’ translation quality ...

متن کامل

The Effects of Research Level and Article Type on the Differences between Citation Metrics and F1000 Recommendations

F1000 recommendations have been assessed as a potential data source for research evaluation, but the reasons for differences between F1000 Article Factor (FFa scores) and citations remain unexplored. By linking recommendations for 28,254 publications in F1000 with citations in Scopus, we investigated the effect of research level (basic, clinical, mixed) and article type on the internal consiste...

متن کامل

Influence of interdisciplinarity on peer-review and bibliometric evaluations in physics research

Ž . It is often argued that interdisciplinary research is valued less in both qualitative peer-review based as well as in Ž . quantitative bibliometric assessments. A recent extensive, nation-wide evaluation of all academic physics groups in the Netherlands allowed us to investigate this problem empirically. Therefore, we first developed an operationalization of ‘interdisciplinarity’. On the ba...

متن کامل

Provide a model for explaining the relationships between performance indicators, errors and employee evaluation methods

This study is practical and its purpose was to present a model based on examining the relationships between three variables: employee performance indicators, human error and employee evaluation methods, respecting the mediating role of methods in the oil refining industry. 281of 1050 official employees of the refining industry were selected by Morgn table for main model and 140 of 220 employees...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • J. Informetrics

دوره 7  شماره 

صفحات  -

تاریخ انتشار 2013